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■ In the present paper a complete description is obtained for the class of admissible (by the 
j — . . terminology of G. I. Ol'shansky) unitary representations of infinite-dimensional analogous 

classical matrix groups GL(oo), Sp(2oo), 0(2oo). 

Henceforth these objects we will imagine as matrix of operators that acts in the complex 

■ Hilbert space H. In a case GL(oo) suppose, that basis {ei, e2, . . . , e n , . . .} of H is numerated 
by the elements from N, and e n is an infinite row with the unique nonzero n-th coordinate 
that equals to unit. 

Let B(H) be a set of bounded operators in H, GL(H) = {g G B(H) : there exist g^ 1 G 
B(H)},GL(n) = {g G GL{H) : gei = g*ei = ei for all i > n}, and GL(co) is an inductive 
limit of the groups GL(n) (n = 1,2,3, ...). 

To definite Sp(2oo), 0(2oo) let's consider in H orthonormal basis 
{. . . , e_ n , . . . , e_2, e_i, e±, e2, • • • , e n , . . .} and represent H in the form H = H- © H + , where 
and H + are generated by basis elements with the negative and positive numbers respec- 
tively. We put GL(2n) = {g G GL(H) : gei = g*ei = ei, if \i\ > n} and define operators s + 
i and S- in if by the formulae : 



■ s + ei = e-i,s-ei = (sign i)e. 

Let GL(2oo) be an inductive limit of GL(2n), Sp(2oo) (0(2oo)) = {5 G GL(2oo) : 
s^g t sZ 1 = g~ 1 (s + g t sj r = g^ 1 )}, where g l is a transposed matrix with respect to g. 

We will denote by G one of the groups : GL(oo), Sp(2oo) or 0(2oo). If a more specific 
setting will be necessary, we'll specially notice it. We denote by U(G) the unitary subgroup 
of group G and remind the definition of the admissible representation. 

Definition ( see || and || ). Let G(n, 00) = {g G G : gei = g*ei = ei for all i : \i\ < n}. 
Factor-representation II of group G, that acts in the Hilbert space H n , is called an admissible 
one, if there exists n G N and nonzero vector £ G H n with the property: n(u)£ = £ for all 
u G U(G(n, 00)). 

In some chapters of this paper it's better to use the equivalent 

Definition of an admissible representation (see Q). The representation II is called an 
admissible one, if the set 



|J {q G H n : Ii(u)n = n for all u G U(G(n, 00)} 



n=l 

is dense in H„ 



'n • 
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Let's denote by G l n the subgroup GL(cc), which consists of matrices ( ^ n J, where 



* * 



I n is a unit n x n— matrix. When n = 0, then Gg = GL(oo). 

Let's give a construction of the representations of group G„, that will be very important 
in our following reasoning. 

Let A m be a set of all complex matrices of m rows and infinite number of columns, v m — 
the Gaussian measure on A m with the unit covariant operator, A anmxm selfadjoint matrix, 
z a matrix of n rows and m columns (z — n x m— matrix). 

Let's define the representation LT^ of group ( LT^ of group GL(oo) = Gq) in 
v m ) by 

(n^ ( ( Q n °) )»/)(*) =| det 5 |* & A (\,gWXg), 

where 

d A (A, 5 ) = exp ^Tr[X(gg* - 1)A* - 2zAA( ff5 * - 1)A* 
I n is n x n -unit matrix, (3 — real number; 

( n A,((t J))*/)(A)=exp[< 5ft IY(*M)MA) 
(ry G L 2 (A m ,zy m )). 

If M is a set of operators in the Hilbert space, and M' is a commutant of M, then we 
can write down 

Theorem 0.1. Von Neumann algebra (II^(G^)) is generated by the operators t(u), 
where u G {v G C/(m) : = At> and zv = z} = U(m, A, z), that acts in L 2 (A m ,v m ) by: 
(r(u) V )(X)=r ] (u*X). 

At first this fact was announced in Q for group GL(oo). 

In H and [10] the complete description of spherical representations of G^ was obtained. 
It's maintained in the following statement: 

Theorem 0.2. Let II be a factor-representation of G^, that acts in a Hilbert space H n . 
If there exists in H n a nonzero vector £, that fixed by the operators Ii{U{G I n )), where U{G I n ) 
is the unitary subgroup G^, then II is multiple (for some m,A,z) by restriction of 11^ to 
subspace {rj G L 2 (A m , v m ) : t(u)t] = 77 for all u G U(m, A, z)}. 

If p is an irreducible representation of U(m, A, z), /o fei (l < k,l < dim/j) is its matrix 
element, then operator 

Pkp = dimp J p kk r(u)du is a minimal orthoprojection from (n^^(G^))'. 

U(m,A,z) 

The main result of the paper in a case of group G^ is a following 

Theorem 0.3. Let II be an admissible factor- representation of group G^. Then there exist 
m,A,z,p such that IT is multiple by restriction ofU Az to P fc ^L 2 (A m , v m ). 

Classification result (see Theorem 6.15) for the groups Sp(2oo) and O(2oo) is obtained 
by the same way. 
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Namely, in §1 there was built the set of unitary representations (reducible ones) 11^ of these 
groups, that have almost the same meaning, as representation H. for G l n . In Proposition 
1.4 the form of their decomposition into irreducible components is obtained. 

The main result of the paper in a case of groups Sp(2<x) and 0(2oo) contains the following 
theorem, which is proved in §6 (see in greater detail theorem 6.15). 

Theorem 0.4. Let II be an admissible factor-representation of group Sp(2oo) or 
O(2oo). Then there exists m x m- selfadjoint matrix A such that II is multiple by one 
of the irreducible components of the representation 11^, that was built in propositions 1.2 - 
1.3 (see proposition 1.4). 

Give a brief account of the logic of our reasoning. The offered method essentially bases 
on the following statement, that belongs to G.I. Ol'shansky. 

Theorem 0.5. // II is an admissible representation of group G, that acts in a Hilbert 
space H n , U u is its restriction on U(G), then 11^ extends by continuity to the representation 
of semigroup of partial isometrics U(G), which are the limiting points of elements from U(G) 
concerning to the weak topology in B(H). 

All the main classification results (theorems 5.7, 5.10, 6.14, 6.15) follow from the structure 
of the spherical representations of group GL(oo) (see fH) an d group of motions G^ (seefjH]]), 

which we'll identify with the subgroup of GL(oo) , that consists of matrices 

where I n is a unit n x n— matrix, * is an arbitrary matrix of corresponding size (see theorem 
2.1). 

For first let's present the idea of the classification of the admissible representations of 
GL(oo) and G^. 

Let G be the one of these groups. If G = GL(oo), then, as before, G(p, oo) = {g € G : 
g^i = 9*£i = 6j for all % : i < n}. When G = G ! n , then we put G(p, oo) = {g G G : gei = ej for 
all i : i < n + p and gei = g*ei = ei for all i : n < i < p + n}. 

If IT is an admissible factor-representation of group G , then for sufficiently large p in H n 
there exists a unit U(U(G(p, oo))— fixed vector £,(p). 

We assume without loss of generality, that H n = [II(G)£(p)] , where [II(G)£(p)] is a 
closure of linear cover of the set {II(G)£(p)} (g £ G). 

The groups, we consider, have so-called property of asymptotic abelianness (see definition 
3.1), that allows to define for II an important invariant -an asymptotic spherical function 
(a. s. f.) c/J n (see proposition 3.2, definition 3.3 and theorem 4.1). It makes it possible for us 
to define the rang r(II) of representation II. 

Henceforth, using the structure of the spherical representation of group G and a fact, that 
restriction of II to G(p, oo), that acts in [U(G(p, oo))£(p)] C H n , is irreducible, we prove, 
that for p > r(II) there exists a set of the unit 

U(U{G(2{p + 1)))- fixed vectors t£ such that 

a) in a case when G = GL(oo) the subspaces [n(G 2(p+1) 
are orthogonal in pairs and 

0F, = p(G)£(p)] = H n 
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(see lemma 5.3 ); 

b) when G = G n the subspaces [n(G2^ +1 ) +n )£. ] = Hi 
are orthogonal in pairs and 



(see lemma 5.8 ). 

That's why for any vector rj £ H n in the commutant of U(G(2(p + 1), oo)) there exists 
an orthoprojection P ri such that for some natural i{rj) [II(G(2(p + 1), oo))P v rj] C H^y 
Change if we need the orthoprojection P v to the lower one, we suppose, that representation 
(II, G(2(p+ l),oo), [n(G(2(p + l),oo))r/]) (a restriction of U to G(2(p + 1), oo), that acts in 
[U(G(2(p + 1), oo))??]) is multiple by (II, G(2(p + 1), oo), P n H n ). 

Therefore (II, G(2(p+1), oo), P v H n ) is a restriction of the direct integral of the irreducible 
representations of groups GL p+1 \ +n ^° ^ ne G(2(p + l),oo) ( n = corresponds to the case 
when G = GL(oo)). Besides that, taking to the consideration statements 5.4 - 5.5, 5.9 
(II, G2( p+1 ) +n , fli(jj)) we can realize in such form that the restriction of every irreducible 
component to G(2(p + 1), oo) is the same representation 11^ ( see lemma 5.5, proposition 
5.6 and lemma 5.9 ). 

Therefore, the irreducible components of representation 

(14, G(2(p + l),oo), P v H n ) 

are unitary equivalent to the irreducible components of representation 
(U Az , G(2(p + l),oo), L 2 (A (n) ,^ r(n) )). 

(n) 

Now let's account an isometry a q , that acts in H by 



a q n \ e i) = ejwheni < nand<j^(ej) = ej+qwheni > n. 



( In \ * / /„ 

If element-matrix 5 = ( n j belongs to G, then a q n ^g(a q n ^) = ( q 

Vftn W ' \h n g n 

(0 q is q x q zero-matrix). 

0\ 

Let g a = I J, + cr^^rt* ■ Obviously g a € G(g, oo) 



,0 0, 

?nds by cor 



By theorem 0.5 II extends by continuity on o~ q n ^ , (c^) and for any nonzero vector 



rj £ iT n (n,G(g,oo), [n(G(g, oo))n(<4 ; )r/]) is multiple by one of the irreducible components 
of the representation 

(n Az ,G(2(p+l),oo),L 2 (A (n) , I , r(n) )), 
when q = 2(p + 1). Therefore in L 2 (A r(n) , f r(n) )) there exists a vector f„, for which 

(U(g)n, r,) = (U(a q ^)U(g)U((a^)*)U(a^)r, ,U(^ q n) )v) = 
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From this follow the classification statements 5.6- 5.7, 5.10. 

Description of admissible representations of groups Sp(2oo) and O(2oo) is essentially 
based on the structure of the admissible representations of GL(oo) and corresponding 
group of motions. As before from the representation II of group G, that coincide here 
with Sp(2oo) or 0(2oo), we pass to the restriction of II to the subgroup GK n C G, 
defined in §3 and taking the same part as a group of motions in a case when GL(oo). 

Besides that, this restriction decomposes to the direct integral of spherical representations, 
for which the explicit realization is obtained (see (30), (31), (32), (33), (34), proposition 6.12 
and remark 6.13). 

Classification concludes (see theorem 6.15) by using theorems 6.14 and 0.5 as in a case of 
group GL(oo). 
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§1. Realization Of The Admissible 
Representations Of The Symplectic And 
Orthogonal Groups 

In this chapter we denote by G one of the groups Sp(2oo) or 0(2oo). To define the 
standard system of generators in G for any matrix x with the elements x jk (j, k = 1,2,...) 
we introduce the matrices 7^°) (x) (x) G G by correlations 

/ 1 n\ / \ T , i ... if j < and k > 

(To ( x ) ~ !). = ' ~ 3 



jk |0 , otherwise 

( 7 (0)(x)-/) 



. J X 3(-k) ' if J > and /c < 
i fe 1 , otherwise. 



Matrices of the form g Q = ^ ^ q ^ ^ J > To "* ( x ) 1 7«°^ ( x ) > where the block structure 

corresponds to the decomposition of H into the orthogonal sum of the subspaces H- and 
H + , generated by basis elements with the negative and positive numbers respectively, and 
(</). k = g_ k _., are the system of generators for G. As has been above, we identify the vectors 

/ = E/i ei e H with the rows (• • • , /_„,■••, /_ 2 , /-1 , /1 , /2 ,■") ■ 

j 

If we denote by i an ordinary transpose, then the following correlations are true: 

7 (o )(x) = 7 (o )(a;t) j 7 (o )(x) = 7 (o )(a . t) ; 
where (z*)fcj = for Sp(2oo) ; 

7 (o )(x) = 7 (o )( _ xt) > 7 (o) (x) = 7 (0) ( _ x t } j 
when G = 0(2oo). 

Let A m consists of all the complex matrices A of the form 
/ An A12 • • • Ai n \ / Aife N 

A m (k) is a set of columns Afc = 



A2I A22 • • • A2n 



V A m l A m 2 • • • X mn ••• / 



A2/C 
V A m fc / 



A is 



a selfadjoint operator on A m (k) , p k (X k ) = exp[-(Afc)*Afc] ,k (Xk) = 

-» -> (k) 

exp[— i(Xk)* AXk] , v, m is a measure on A m (k) with a density p fc as regards the 
Lebesgue measure 

k=i 



We denote by L m a Hilbert space, that is an infinite tensor product ® L (A m (k), dXk) 

fc=i 

A ~ * A — * ~ * h 

with the stabilization defined by the sequence rj fe (Afc) = K fc (Afc) • [/9 fe (Afc)] . Namely, 

A A A 

L m is generated by the vectors of the form f\ ® / 2 ® . . . ® f p ® rj ® 77 ® . . . (p € iV ) . 
For /(0 = /J ®/^ ®...®/^®^®^®... (Z = l, 2) the scalar product (/ (1) -/ (2) ) 
in L m is evaluated from formula 

00 . 

(/ {1) -/ (2) ) = 11/ /p 1 '' fip)fp 2 ^ (Xp)dX p dXp . 
p=1 A m ( P ) 
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In L 2 (A m (k), dX k ) let's define the operator of the Fourier transformation F k : 
(*fc/*)(A fc ) = ^^^^^ / exp{i» [2(^/1 + 4^ X k ) X k }} ■ f k (X k )dX k 



A m (fc) 



The next statement we can obtain using the ordinary calculations. 

AAA 

Lemma 1.1 // A = A* and A = ±A, then F h ri = r> . 

K k k 

From this lemma follows that the operators in the next statement are defined correctly. 

Proposition 1.2 Let in L m the action of operators n A (g) (g G Sp(2oo)) 
is defined by formulas : 



(U A (g )O(X) = \deb 9 n(Xg) , 

(n A ( 7 f(x))0(A) = (i) 

exp{i KTr [yfT+ 4A 2 AxA*]}£(A) , 



(U A (s-)0(X) = (F A 0(X), where F A = § 

k=l 

If A = A* and A = — A 1 , then operators H A (g) define the representation of group 
Sp(2oo) . 

Let's give a similar realization for group 0(2oo). 

Proposition 1.3. Let m = 2k and matrix A = I ^( 2 ) J > where X ( ' consists of the 

first k rows of X £A m ,P=^ ^ k ^j (I k is k x k unit matrix). If A 1 = PAP^ 1 , 
then operators R A (g) (g G O(2oo) , that are defined by the correlations : 

(U A (g )O(X) = \det g\ m Z(\g) , 

(n A ( 7 (°)(x))e)(A) = (2) 

exp{i KTr [ y/l + A(A*) 2 PAxA*]K(A) , 

n A ( s ) = F > define the representation of group 0(2oo). 

For the decomposition of the representation IT A to the irreducible components let us 
consider two groups : 

0(A, m) = {u G U{m) : u* = u* and [A, u] = } , (3) 

Sp(A, m) = {ue U{m) : u* = iVF" 1 and [A, u] = 0}. (4) 
Let (r(u)£)(A) = ^(u' 1 X) , where u G U(m) , £ G L A m . 
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If G(A, m) is one of the groups 0(A , m) or Sp(A , m) , p is its irreducible represen- 
tation, a p kk is matrix element of p, then P£ = dim p J aP k {u)r(u)du is an orthogonal 

G(A,m) 

projection, that acts in L m . 

The following statement was announced at first by G.I. Ol'shansky in Q. 
Proposition 1.4. Let p be some set of the operators, that act on L m , p' is a commutant 
of p . Then the following statements are true: 



i) ifH A such, as in proposition 1.2, then 
[n A (Sp(2oo))]' = ((r(0(A,m))Y)' = r(0(A, m))"; 
II) i/II A such, as in proposition 1.3, then 
[H A (0(2oo))}' = r(Sp(A, m))"; 
in) restriction of Tl A to P? is irreducible. 

§2 Some Properties Of The Representation 

Of Groups GL(oo) 

Let IT be an irreducible representation of GL(oo), acting in a Hilbert space H n with the 
unit cyclic vector £ fixed with respect to the operators H(u) (u G U(GL(oo)) = U(oo)). 

Then by the results of the paper Q the class of the unitary equivalence of II is defined 
by a spherical function 

| det(g)| 4/3 det[/ (n) tg> chln\g\ - 2iA® sh\n\g\], (5) 

where \g\ = (g*g)^ , r(n) is a natural number, (3 is a real number, J r(n) is a unit 
r(n) x r(n)— matrix, A is selfadjoint (s.a.) r(n) x r(n)— matrix. 

The natural number r(n) we call the rang of the representation II. 

We denote by Z m a set mxmof the upper triangular matrices with positive elements on 

/ z o " 

the diagonal. Let subgroup D m C GL(oo) consists of the matrices of the form I m 

where z m E Z m , x m is matrix with the finite number of nonzero elements. 

Let us give a classification result for the spherical factor representations of group G^ n C 

G-L(oo) that consists of matrices of the form ( n ) , where * signifies some matrix of 

V * * / 

the corresponding size. 

Theorem 2.1. (see [|10[) Let H be irreducible spherical factor representation G^ that 
acts in H n a A (\,g) = ex.p{^-Tr[\(gg* — l)\* — 2iA\(gg* — l)\*]},whereA is s.a. mxm — 
matrix. 

Then there exist : s.a. mxm — matrix A, n x m — matrix z , real number (5 such, 
that II unitary equivalent to the restriction of representation H A of group G^ defined in 
L 2 (A 

mi I'm) by formulas: 

( °) )r/)(A) =| detg f a A (X, g)n(Xg), 



S 



{U Az ( ( \ ?) )^ A ) = ex P^ K *>(*M)fo(A) (6) 
(77 G L 2 (A m ,z/ m )), 

to the subspace [n^ (G^)£ ] , where £ G L 2 (A m ,u m ) and corresponds to the function on 
A m i/ia£ identically equals to the unit. 

Using the form of the operators IL A (g) (g G G^) we can prove the following statement. 
Theorem 2.2. Lei subgroup D mn C G^ (G^ = GL(oo) , D m o = D m ) consists of 

fin 0\ 

matrices of the form * 2 m (z m G Z m ) , II is the same as in theorem 2.1. Then 
\ * * // 

[n(Z) mr j)£] = [II(G^)^] , w/iere ^ is an arbitrary nonzero ^^{G^)) — fixed vector. 

§3. Asymptotic Properties 

Of The Admissible Representations 

Let G = Sp{2oo) or O(2oo) . The subgroups Gd , T , C G consist of matrices of 
the form g = ( q ) > ^o "* ( x ) ' 7u°^ ( x ) respectively, where x is a matrix with the 

elements x jk (j, k = 1, 2, . . .) , and the block structure is defined by the decomposition of H 
into the orthogonal sum of the subspaces iJ_ and H + (see §1). 

If (x 1 ) = x . , then the correlations are true 

^(x) = 7 ?V), 1 ^{x)= 1 ^{x t ) for Sp(2oo); 
7 (0) (x) = 7 (0)(-x*), 7 (°)(a:) = 7 ( )(-^)forG = O(2oo) . (7) 



Let b be a matrix with the elements 6 jfe , where j, k = 1, 2, .... As in §1 let's define the 
matrices 7 ^ n ^ (6) and 7 ^ n ) (6) G G by the correlations 



jk 



J, . ... , , if 7 < — n and k > n 
, otherwise 

5. . , , , if 7 > n and /c < — n 
, otherwise. 



Let F(oo, n) be a set of all the local nonzero (00 x n)-matrices with the infinite number 
of rows and n columns. If x = [x jk ] , y = [y jk ] (l<j<oo,l<k<n), then we define 
matrix 9^ n \x,y) G G by the correlation 



(i — njm 
(*^ )(_j)(_ m _ n ) 

y (—i—n)m 

f (-i)(m-n) 





if i > n and 1 < m < n 
if — n < i < — 1 and m < n 
if i < — n and 1 < m < n 
if — n < i < — 1 and m > n 
otherwise , 
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where y^ = y l for G = Sp(2oo) and y" = —y l for G = O(2oo). 

At last we denote by 8^ (a) an element from G , that defined by n x n —matrix a = 
[a jfc ] (1 < j, k < n) with respect to the correlation 



{5^{a)-I) i 
Let 



a { _ i)m , if — n < i < — 1 and 1 < m < n 
, otherwise. 



9n 



where {cf) iy = g ( _ k)( _ z) (k,i < 0) 



/Or 1 )' o o o\ 

7 n 
/„ 
gj 

Let G d (n,oc) (G d (0,oo) = G d ), rg») (n > 1), rW (n > 1), AW (n > 1) are 
the subgroups of G, which consist of the matrices of the form g n , 7^ n - ) (6), ^^(b), S^ n \a) 
respectively. Moreover, when G = Sp(2oo) , a is symmetric matrix, and when O(2oo) — 
is antisymmetric one. A set of all the elements from G of the form $( n \x,y) we denote by 
0W (n > 1) . Observe that 0^ is not a group. 

The following correlations are true : 

^\b)9^{x,y)^\-b) = 

8^ n \-{bxfx) e in \o,bx)e {n \x,y) 

7< b W b) (*,v)7< b) H0 = 

5^\(by) t y)e^(by,0)e^(x,y) (8) 

e^( Xl , yi )e^(x 2 ,y 2 ) = 

S^ixly.-ylx.-xly.+ylx^ix^y^ix^y,), 
g n e^{x,y) g' 1 = e { ~ n Xgx,{g t )- 1 y). 

Let subgroup K n be generated by &^ and A( n ). From the correlations (8) it follows, 
that the elements of the group G(n, oo), that is formed by Gd(n, oo) , rj"), naturally 
act by the automorphisms on K n . We denote by GK n a subgroup of G generated by G(n, oo) 
and if n . 

Let's introduce a useful property of the infinite-dimensional groups. 

Suppose, that group G is an inductive limit of the finite-dimensional matrix groups G(n) 
(G(n) C G(n+ 1) (n = 1, 2, 3, ...)). 

Definition 3.1. Group G is called an asymptotic Abelian one (a. a.), if there exists 
a sequence u n (n G N) of the elements of subgroup U (G) that coincide with a set of the 
unitary elements of the group G with the properties : 



i) for any /, n G N and g G G(l) there exists k(g,n) G N such that for 
k > k(g,n) ut g u* k G {h G G : hp = ph for all p G G(n)} = G'{n); 

ii) for any n G N there exists l(n) G N, for which u* t G G'(n) when k > I > l(n). 

Proposition 3.2. Set G is .. matrix group, that is an inductive limit of the finite- 
dimensional groups G{n) (n G N) , II is a factor-representation of G , that acts in a Hilbert 
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space H n with a cyclic vector £. Moreover, set 

oo 

U {v G H n : U(u)r) = n for all u G U(G) n {h G G : # = g h for all g € G(n)}} dense 

n=l 

in iJ n (This property, as was shown by G.I. OVshansky, is one of the equivalent definitions 
of the admissible representation in a case of the large class of the inhnite-dimensional groups, 
that includes GL(oo) , S"p(2oo) , O(2oo) ). 

hen for any unit vectors 771, 772 G H n 

fviid) = lim (II(u, g u*) m , r?i) = lim (n(u, g u*) r) 2 , r? 2 ) = <P V2 (g) ■ 

Moreover, the limits do not depend on a choice of the sequence ui (I G N) from the 
definition 3.1, and <p m = (p m is an indecomposable spherical function on G . 

Proof. For any e > there exists n G N and unit vectors £(e) rfi(e) G H n (i = 1, 2) 
with the properties: II(«)£(e) = £(e) , U(u)rji(e) = r/i(e) (i = 1, 2) for all u G [7(G) n ; 

||£ - e(e)||<e; - ^(e)|| < e . (9) 

By the definition 3.1 we choose I G N such, that Uk u* £ G' n for all k > I. Then, using 
(9) we get : 

2e > |(II(u fc g u%) n { m) - (U(u k g u%) ra(e) rn(e))\ = 
\{U{u k g u%) rji rji) - (U( Ul g u* h ) ^(e) , ^(e))| . 

Hence and from (9) it follows that 
|(n(n fc g u%) r]i rji) - (U(ui g u*) 77, r)i)\ < 4e for all k > I. 

Since e is an arbitrary, then (Jl(u k g n£) rji rji) is a fundamental sequence. Therefore the 
limits of sequences (H(u k g u* k ) rji rji) (k E N) exist for every i = 1, 2. 

Moreover, from the correlation 

lim n(u; u u*) rji = rji V u G U(G) 
1^00 

we get, that 

ip m (ugv) = tp m (g) V u, v G U (G) . 

Therefore ip m and (p m are the spherical functions on G. 
Let's prove the coincidence of ip m and ip m - 

As £ is a cyclic vector, then for any 5 > there exist the collections {g., } i {% = 1, 2) 

fc i= i 

of the elements from G{n) and numbers {c, j^ 1 (i = 1, 2) from C with the properties 

lk i ki=i 

Ni 

11 £ C ^ n( ^ " ^11 < 5 ( i = 1 > 2 ) ( 10 ) 

Since IT is factor-representation, then, using (10), we get 

25 > I lim (U(ui g u*) rji rji) - 
1^00 

Ni Ni 

lim (u( Ul g «?) ^ c n( 5 )e £ c n( 5 )e )| = 
fc;=l * * k~=\ * * 
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lim (n(ttj g u*) rji th) - lim (II (mj g u*) £ £) 



I— >oo 



I— >oo 



Ni 

^=1 * * 



Since <5 is arbitrary, then from this and from (10) follows, that tp^ {g) = f/?„ 2 {g) V <y € G . 
The proof of the indecomposability of (p^ is based on the correlation 



lim ip Vl (uig u* h) = ip Vl (g) <p m (h) V heG . 

I — >oo 



Definition 3.3. A spherical function on a. a. group G defined in accordance with the 
proposition 3.2 by the admissible representation II is called an asymptotic spherical function 
(a.s.f.) and it is denoted by <p$ ■ 

Theorem 3.4. Let G be an a. a. matrix group, that is an inductive limit of finite- 
dimensional groups G(n)(n € N) ,11 is the same, as in the proposition 3.2, £ is a unit cyclic 
vector for II fixed with respect to U(u{) (I £ N), where U\ is a sequence from U(G) that 
guarantees a. a. of G. 

hen subspace H u = {n £ H n : TL(ui)rj = rj for all I € N} is one- dimensional. 

Proof The proof is completely similar to the proof of the Multiplicativity Theorem from 

i- 

Definition 3.5. We define the rang r(II) of the admissible factor-representation H of 
group G, that coincides to the one of the following groups : GL(oo) , G^ , Sp(2oo) , O(2oo) , 
GK n as a rang of the representation that defined by the indecomposable .s.f. (p^ of 

group GL(oo) (G = GL(oo)) ; GL(n, oo) , where G = G^ ; Gd (G = Sp{2oo) or 
0(2oo) ); G d r\G{n,oo) (G = GK n ) (see §2). 



§4 . Properties Of The Admissible Representations 
Of Group GL(oo) And The Group Of Motions 

We may take the group of motions to be the subgroup of G^ £ GL (oo) (see §2) 

Theorem 4.1. Let II be an admissible representation of G , where G coincides with the 
one of the groups GL (oo) , G n , Sp(2oo) , 0(2oo) , GK n ; £i , £2 are Yl(U(G(n, 00)) —fixed 
vectors from H n . hen (II(<?)£i £1) = (11(g) ^2 £2) for all g G G(n, 00) . 

To prove this theorem it suffices to notice, that the groups from the condition are the 
asymptotic Abelian ones, the set 

U {77 £ H n : H(U(G' n ))r] = -q} is dense in H n and to use the proposition 3.2. 

n 

In GL(oo) we consider a subset Y p that consists of matrices of the form 

/ 2/11 2/12 • • • Uip <5i ... \ 

* * ... * * 82 ...0 

* * ... * * * * <5 S 
where p > 1 , (5 S > V s G iV. 
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Lemma 4.2. Let H be an admissible factor-representation of group GL(oo) , £ is its 
cyclic vector fixed with respect to the operators H(U(G(p, oo))) . hen [IL(Y p )£\ = [n(GL(oo))£]. 
To prove the lemma it suffices to notice, that GL(oo) = Y p U(G(p, oo)) . 

Lemma 4.3. Let II, p, £ are the same as in lemma K2 P is a subgroup of GL(oo) 

that consists of matrices of the form , where gu is an arbitrary (2p) x (2p) — 

matrix, p > r(II) . hen H n = [U(K2 P )t;] ■ 

Proof. It's easy to check it, that the closing of the set K2 P GL(p, oo) includes 
Y p . Next, by the statements 3.2 and 4.1 a restriction of II to GL(p, oo) , that acts in a 
Hilbert space \Yl(GL(p, oo) )£] , is a factor-representation. According to the theorem 2.2 (for 
n = 0) \£l(GL(p, oo))£] = \Yl(GL(p, oo) n A"2p)£] • From this and from lemma 3.2 we get 
rn(GL(oo))£| = [II(Yp)£] = [n(iT 2f) GL(p, oo))£] = [n(^ 2p )£] • Lemma 4.3 is proved. 

The following analog of the statement above might be proved by the same way for group 
Gi C GL(oo) . 

Lemma 4.4. Let II be an admissible factor-representation of group G^ , £ is a 
cyclic vector fixed with respect to operators H(u)(u € U(G(p + n, oo)) , k!$ is a subgroup 

/In 0\ 

of G^ , that consists of the matrices of the form * g 22 , where g 22 is an arbitrary 

\ * * L J 

(2p) x (2p) — matrix. 

If p> r(n) (see definition 3.5 ), then [Ii{K ( 2 ^ )£] = [II(G£)£] . 

§5 . A Description Of The Admissible 
Representations Of The Groups 
GL(oc) And G T n 

Let II be an admissible factor-representation of G , that in first two statements of this 
chapter may be one of the groups: GL(oo) , G^ , Sp{2oo) , 0(2oo) . 

(n) 

Isometry Oq , that acts in H by the formula: 

a q n \ei) = Ci for i < n and a q n \ei) = ei +q for i > n 

(n = corresponds to GL(oo)), is a strong limit of the elements of unitary subgroup 
U(G^) . In a case of groups Sp(2oo) , 0(2oo) this property belongs to isometry a q defined 
by the correlation a q (ei) = e i+l ^ signi)q . 

We denote by 11^ a restriction of II to U(G). By the results of paper p 11^ is a continuous, 
if U(G) C B(H) and U(H n ) C B(H n ) are the topological groups with respect to the strong 
operator topology. Therefore, 11^ extends by the continuity to the representation of semigroup 
U(G) , that includes all the isometries, which are the limiting points with respect to the weak 
operator topology on U(G). Obviously, a q n ^ , a q belong to U(G) . 

Theorem 5.1. If Eiis an orthoprojection to the subspace H(o~) H n , where a equals 
to a q n) or o q , then 1%) E x - E x 11(g) = [11(g) , E x ] = for all g G G(l, oo) . 
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Proof. Since II is extended by the continuity to a , then for arbitrary g G 
G(Z,oo) o* go G G and U(a*) U(g) U(a) =U(a*ga). 

Therefore, n(<r*) E\ H(g) E\ II(cr) is a unitary operator in . Hence, accounting that 
n(cr)) is an isometry, we get, that E\ II(<7) E\ is a unitary operator on E\ H n . 
Because of the same reason E\ n(^) (I — E\ ) = or E\ H(g) = E\ 11(5) E\ . 

If we use the similar reasoning for g 1 , we'll get : E\ II(g 1 ) = E\ II(<7 1 ) E\ . Therefore, 
H(g) Ei = Ei H(g) . The proof of theorem 5.1 is complete. 

Let £ be a cyclic vector for the representation II , n(it)£ = £ for all u G U(G(p, 00)) , p > 
r(n) and q <E N . 

Proposition 5.2. Pitt £ g = n(cr)£ , where a equals to o~ q n ^ or to a q , H q = 
[U(G(q,oc))^ q ] . hen 

a) H q = U(a) H n ; 

6j representation (II, G, H n ) is unitary 
equivalent to the representation defined by the 
chain of mappings: 

G Jl, G ( g , 00) (n(G((/, 00)) , # 9 , ) , 

where i g (g) for g £ G is defined by the correlations 
o-* i q (g) o = g , i q (g)ei = e x for I = 1, 2, 3, . . . , q . 

Proof. We note, that [U(a*)U(G(q, oo))U(a) f] = [11(G) £] = iT n . Therefore, 
n(<7*)[n(G((z, 00)) £,] = # n or £ 9 [n(G(g, 00)) £ q ] = U(a)H n , where £ g = U(a)U(a*). 

But by the theorem 5.1 E q G n(G(g, 00)) . Therefore n(a)i^ n = 
£ , g [n(G(g, 00)) £ 9 ] = [II(G(g, 00)) £ q ] = H q . Thus correlation (a) is proved. 

Statement (b) follows from this chain of equalities : 



(U(g)ti,0 = (U(**i q (g) *)£,£) = (U(a*)U(i q (g))U(a) = (U(i q {g)) . 
The following statements 5.3- 5.7 refer only to group GL(oo) . Let q = 2(p + 1) , where 

P > r(n) . 

Lemma 5.3. In H n there exists a set of vectors {£,1} (i G N , £1 = with the 
properties : 

a) the subspaces H q (i) = [II(G£)&] (9 = 2(p + 1)) 

are orthogonal in pairs for the different values of index i 
and ®iH q (i) = H n ; 

b) n(6) = & for all ieN and u G U(GL(q, 00)) . 

Proof. Let {g^} (k G iV) be a dense subset in GL(q) ; £1 , £2 , ■ ■ ■ , £n are the unit 
vectors from H n , for which the subspaces H q (i) = [n(G{)£j] (1 < % < n) are orthogonal in 
pairs. If k(n) = min{fc : n(<? fc )£ £ ®f =1 H q (i) } and tf n (n) = {H u - {®f =1 H q (i)}} 

then put £ n+ i = | | p " ^ fc ( n )^ ^ ^ where P n is an orthoprojection on H n (n) . 

I \-tn *-i-\gk(n) ) ? 1 1 

If we continue this process, we will get the system of vectors {£j} (i G N) (possibly the 
finite one) such that U(g k )$, G eg x H q (i) for all k G iV and II(u)£j = & Vu G 00) . 
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Now this statement follows from lemma 4.3. 



Let E q (i) be the orthoprojection on H q {i) (H q {i) = E q (i)H n ). Prom lemma 5.3 it 

i 

follows that exists i, for which E q {i)^ q ^ . If E q {i)E q = V q (i) [E q E q (i)E q ] 2 is a polar 
decomposition of E q {i)E q , e q (i) = V*(i) V q (i) < E q , f q (i) = V q (i)V* q (i) < E q (i) , then 
from theorem 5.1 and lemma 5.3 we get, that V q (i) G (II(GL(g, oo)))' . 

Since (II(GL(oo)))" = {(H{GL(oo)))')' is a factor, then by the proposition 5.2 
w* —algebra (H(GL(q, oo))) ' of operators, that act in H q , is also factor. Because of this, 
accounting theorem 5.1, we get, that the next chain of the mappings 

aG (U(GL(q, oo)))" E q — ► e q (i) a G (IL(GL(q, oo)))" e q {i) — » 
— > F g (»)e,(i)aF 9 (i)* = /,(i)a G (n(GL(g, oo)))"/,(») 

is an isomorphism (n(GL(<7, oo)))" .E 9 = 
= E q (U(GL(q,oo)))"E q on /,(t) (n(GL(</, oo)))" f q (i) = 
f q (i)(U(GL(q, oo)))" C (n(GL(g,oo)))"^(i). 

Therefore, by the proposition 5.2 the class of unitary equivalence of the representation LT 
of group GL(oo) is determined up to the multiplies by the restriction of II to GL(q, oo) , that 
acts in some invariant subspace f q (i)H n C H q (i) with a cyclic vector £ q (i) = V g (i) £ q . 

Let 

(II(Gj),iZ,(i),£i) = J(n s (G I q ),H q (i,s),Ci(s))d^s) (11) 
s 

be a decomposition of the restriction of representation II to group G q , that acts in H q (i) , 
into a direct integral of the irreducible spherical representations, that corresponds to center 
Ci of algebra (Ii{G q )) , where 5 is a spectrum of Q , fx is a probability measure on S . 

Using the classification of the spherical representations of group GL(oo) , the proposition 
3.2, theorem 4.1 and the fact that q > 2(r(II) + 1) , we can prove the following statement. 

Lemma 5.4 There exist selfadjoint matrix A with a size r(II) x r(LT) and a real number 
(3 such that 

(n^)^),^))!!^)!!- 1 = 

det(\g\) lf3 det[/ r (n) <8> cosh(ln |^|) - 1iA ® sinh(ln \g\)\ 
V g G GL(q, oo) and fx — almost all (a. a.) s £ S . Moreover, for fi— a.a. s G S 
[II s (Gg)£i(s)] = [ILj(jVg)£i(s)] , where N q consists of matrices of the form 

From this and from the complete classification of the spherical representations of groups 
of motions G l n (see |H| ) it follows 

Lemma 5.5. There're exist : isometry V , that maps H q (i) to L 2 (S, /x)®-L 2 (A r(n) , f r(n) ) , 
and /x— measurable mapping z from S to the set of all the complex q x r(LT) matrices such 
that the action of the operators ft.(g) = VH(g)E q (i)V^ 1 (g G G q ) is determined by 
correlations : 

(fl A (g)r,)(s) = U A rj(s) (12) 



15 



(see (6)) , where n(s) G L (A r(n) , f r(n) ) /or all s £ S . 
Moreover, there exists a [i— measurable mapping f q (i, ■) from S to the set of the ortho- 
projections of w* -algebra (U (GL(q, oo)))' C B(L 2 (A r(n) , f r(n) ) ) , /or w/nc/i 

(W)^- 1 ^) = /,(M)i(«) • 



For u G f/(r(II),A) = {u G £/(r(II)) : [u, A] = 0} we define operator t(u) in 
L2 ( A r( n) > ",(n)) W 



(r(u)O(A) = £(u*A) . (13) 

Denote by f (it) a natural extension of r to L 2 (S, //) ® -L 2 (A r(n) , f r(n) ) • Namely, 
f(tt) = I ® t(u) . 

If k is irreducible representation of group U(r(H),A) , Kik is a matrix element of operator 
n(g) , then 

Pf = dim(«) / ku(v)t(v) dv is an orthoprojection from w*— algebra 

l/(r(n),A) 

(H^^^oo)))' ( See ( 6 ))' that acts in L2 ( A r(n) > ^(n)) • 

Obviously operators P* = I ® and f(it) V it G f/(r(II), A) belong to 
n A (GL( g ,oo))' . 

Without loss of generality suppose, that for k and % introduced above P* Vf q (i)V~ l ^ . 

Let w\VfgV~ 1 P- i Vf q / V~ 1 \^ be a polar decomposition of operator PfVfq^V -1 . Since 
(fi j4 (GL(g, oo)))"y/ g (i)V -1 is a factor , orthoprojection w*w < V f q {i)V~ l , w , 
V f q {i)V~ l G (TL A (GL(q, oo))) , then, using the statement of theorem 0.1 and the fact that 
orthoprojection Pf is a minimal in (n^^ (GL(q, oo))) C i?(L 2 (A r(n) 

we get: 

the restriction of IL A to GL(q, oo) , that acts in 
F/^ilF-^L^./i) ® L 2 (A r(n) , i/ r(n) )) , is multiple 
by the representation of subgroup GL(q, oo) in 
ww*{L 2 {S^)®L 2 ( A (n) , u r{nJ ) ) ) defined 

by correlation wIL A (g)w* = H A (g)ww* ; 
ii) if f(s) is |U —measurable field of orthoprojections, 
that determines orthoprojection ww* , then there exists 
subset S' C S of the positive measure such that 



^r(n) - 



f(s) 



Pf, if se5' 



0, if sgS' 

The facts above are summed by the following statement. 

Proposition 5.6. In the commutant of representation (II, GL(q, oo) , H q ) ('see propo- 
sition 5.2) there exists an orthoprojection f such, that (II , GL(q, oo) , fH q ) is irre- 
ducible and unitary equivalent to the restriction of U A to group GL(q, oo)) , i/iaf acis in 

From this and from proposition 5.2 (b) it follows the main classification 
Theorem 5.7. An arbitrary admissible factor-representation II of group GL(oo) 
has a type I and it is multiple by representation H Az of group G J n forn = 0, z = (G* = 
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GL(oo) ) , that acts in Pj K L 2 (A r(n) , ^ r(n) ) , for some selfadjoint matrix A of size r(II) x r(II) 
and orthoprojection Pf , where k is irreducible representation of U(r(H), A) , (see (6)) . 



A statements analogous to statements (5.3) - (5.6), from which follows theorem 5.7, might 
be modified for group G l n . 

Let II be an admissible factor-representation of group G^ (n > 1) , £ is a cyclic vector for 
II , r(Il) is a rang of II (see the definition 3.5), n(u)£ = £ for all u G U (G(p + n, oo)) , q = 
n + 2(p+ 1) , p > r(II) . 

The following statement is analogous to lemma 5.3 for group G l n . 

Lemma 5.8. In H n there exists a set of unit vectors £j (i G N) (£i = 1) w/?f/t i/ie 
properties : 

a) subspaces H q {i) = [II(Gg)£j] (g = n + 2(p+l)) are orthogonal 
in pairs for different i and ®i € jyH q (i) = H n ; 

b) Il(u)£j = £j /or all i and u G U(G(q, oo)) . 

Proof might be done by using the statement of lemma 4.4 and analogous to the ground 
of lemma 5.3. 

If E q , £ g are the same as in proposition 5.2, then repeating the reasoning we've done for 
GL(oo) , let's find the orthoprojection f q (i) G (II(G(g, oo)))' such that f q (i)H n C 
and (n , G(q, oo) , H q ) is multiple by (II , G(q, oo) , f q (i)H q {i) . 

Hence accounting theorem 2.1, statements 3.2, 4.1 and the decomposition 
(U(G q ) , H q (i) , £j) = f(U s (G q ), H q (i,s), ) <Z/i(s) , where the objects we've met are 

described in (11), we get the statement analogous to lemma 5.5 for G l n . 

Lemma 5.9. There exist : s.a. r(II) x r(II) — matrix A, //— measurable mapping 
z from S to the set of matrices of q = n + 2(p + 1) rows and r(II) columns of a form 

z(s) = ^ Z ™ ^ , where z n is independent of s matrix of height n ; isometry V , i/iai maps 

iZ,(i) to I?{S,n) ® L 2 (A r(n) , i/ r(n) ) such that operators fl Az (g) = VU^V' 1 (g G G q ) , 
where IL is a restriction of H to H q (i) , are defined in L 2 (S,fi) <g> L 2 (A r(n) , f r(n) ) fry 
correlations (6) and (12). 

Let C/(r(n), A, z n ) = {u G L r (r(L T ),^4) : z„u = z n } . As before we define by the irre- 
ducible representation k of group L r (r(L T ), A, z n ) the orthoprojection Pf . 

The reasoning for group GL(oo) , introducing in this chapter with a slight change might 
be carried over to the case of group G^ and they're leading to the following statement . 

Theorem 5.10. For the admissible factor-representation II of group G l n there exist : 
s.a. r(II) x r(n) — matrix A, n x r(II) — matrix z and orthoprojection Pf 1 such that U is 
multiple by restriction of representation ^ Az (see (6)) to subspace P* L 2 (A r(n) , f r(n) ) • 

§6 . A Description Of The Admissible Representations 
Of Groups Sp(2oo) And 0(2oo) 
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The main result of this chapter is theorem 6.15, that establishes a completeness of the 
collection of the admissible factor-representations, that was built in §1, for groups Sp(2oo) 
and 0(2oo). We suppose that G coincides with the one of the groups Sp(2oo) or O(2oo). 
Otherwise we'll specialty notice it. 

Let Oj™' 1 be a subgroup of 0( n ) , that consists of matrices of the form 9^ n \x,0) , GN n = 
Gd(n, oo) 0^ . Notice, that subgroup GN n is naturally isomorphic to the group of motions 
Gn ■ 

Proposition 6.1. // LT is an admissible factor- representation of group G , of the rang 
r(n) that acts in a Hilbert space H n , rj is a nonzero vector from H n and n > r(II) , then 
the following properties are true : 

i) in a subspace = \n(GN n )rj] there exists 
a nonzero vector rj u , for which U(u)rj u = n u 
VuG U{GN n ) ; 

ii) if (n(GN n ),H v ,rj) = KnsiGNn),!!^),^)^^)- 

s 

is a decomposition of (LT, GN n , H^) into a direct integral 
of the factor-representations corresponding to the center of 
(U(GN n ))" , then for u.- a.a. seS (U s ,GN n , H v (s)) 
is multiple by (Jl Az(s) , GN n , i^L 2 (A r(n) , u r(n) )) 

(see theorem 5.10 and (6)). The rang of matrix z(s) being 
equals to r(LT) for fi—a.a. s € S. 

Proof is based on the theorem 4.1, the classification statements 5.7, 5.10 and the analyses 
of the concrete realization of representations of group Gd , that is isomorphic to GL(oo) . 

Remark 6.2 Let LT be the same as in a proposition 6.1, £ is a cyclic vector for LT ( H n = 
[n(G)^]) . hen for IT and G the theorem 5.1 and the proposition 5.2 are true. Namely, a class of 
the unitary equivalence of representation H of group G is uniquely determined by restriction 
of IT to G(q, oo), that acts in H q = [r%, oo)£ ? ] , where £ q = U(a q )(, (a q ei = e i+ ^ igni ) q ) 
(see proposition 5.2). 

We denote by E q the projection of H n to H q . 

From the proposition 6.1 there follows an important 

Lemma 6.3. LetH be the same as in conditions of statements 6.1 - 6.2, q = r(IT). There 
exists H{U {GK q )) — fixed unit vector 7] q U) G H n with a property: ifE is an orthoprojection 
of H n to [U(GK q ) Vq U) } , then E { q U \ q + . 

Proof. As T) q we should take the unit U(U(GN q )) — fixed vector from subspace 
= [n(GA r g )^ g ] , that exists by proposition 6.1 (i). It satisfied to all the conditions of the 
lemma, but it may be not U(U(GK q )) — fixed. The last property follows from the complete 
description of the structure of an admissible representations of group U{GK q ) , that was found 
by .. Kirillov in Q, and from the fact that vector n q U) is U(U(GN q )) — fixed. 

Let v q \E q E q U) E q \^ = E q U) E q be a polar decomposition of operator E q U) E q ,v q *v q = 
e q < E q , v q v q = e q <E q . 

Diminishing, if we need, orthoprojection e q and accounting the fact that v q E 
U(G(q, oo))' , nd U(G(q, oo))" is a factor in H q , and using the statements 6.1 - 6.2 we get 
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Proposition 6.4. Let II be the same as in statements 6.1 - 6.3. The representation 
(II , G(q, oo) , H q ) , that is a restriction of II to the group G(q, oo) and that acts in H q = 
[U(G(q,oo))£ q ] is multiple by (II , G(q, oo) , e q H n ) , where e q H n ) C [H(GK q )v q £ q ] C 



\IL(GK q )Ti, 



H q U) , rj q U) is a unit H(U(GK q )) — fixed vector. 



Proof follows from the correlation v q Yi(g)v* = v q e q Il(g)v q = v q e q v*U(g) = e q U) H(g) 
Vg G G(q, oo) . 



Let's begin the analysis of restriction of II to GK q , that acts in H t 



(u) 



Proposition 6.5. Let C(M) be a center of w* — algebra M , U, n q U) are the same as in 
the condition of proposition 6.4, q = r(n) . hen C(H(GN q )") C C(H(GK q )") . 

Proof Let 0( n >«) = 6^ n 6^ (n > q) , = e[ n) n {n ' q) , GK n>q {GN n , q ) 

is generated by G(n, 00) , A q and 0( n,? ) (Gd(n, 00) and eS n,9) ) . Obviously GK M = 



GK q , GN m 



GK q . 



If we prove the correlations 



C(U(GK g )")E q U) = C(U(GK n J')E q V 

n>q 



C(U(GN q )")E q u> = f) C{H(GN n . q )")E q U) 

n>q 

then from the fact that GN q C GK q , our statement will follow. 

Let c G C(J[{GK q )")E q U) . There exist the collections of the elements <j g 

GK q n G(i) and the complex numbers < > (i G N) with the properties: 

iki 



(14) 
(15) 



iki 



N. 



i kj 



C 



N. 



< C 



N. 



lim 



^c ik Mg ik% )f-cf 



V / €<>■ 



(16) 



Next we notice, that in U(Gd(q, 00)) there exist a sequence of elements Ui (i G N) with 
the property 

(17) 



Ui9 ik- Ui 



g' G GK hq \Ji>q. 

(V) . 



Hence accounting (16) and the fact that vector 77 is U(U(Gd(q, 00))) —fixed we get 



N. 



lim 



(u) 
1 



. 
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This correlation and (17) lead to the following chain of equalities: 



lim 

i— >oo 



N. 



(u) 



(U) 
CVq 



N. 



lim 

i— >oo 



(£/) 

9 



Cll(5)77, 



, 



that are true for all g £ GK q . 

Hence accounting (16), we get the property (14). Correlation (15) are proved by the same 
way . The proposition 6.5 is proved. 

Proposition 6.6. Let IT , q , 77^ , H q U) are the same as in proposition 6.5, 
(II, GK q , H q U) ) = J (n s , GKg , H q U> (s) )dii(s) is a decomposition of (II, GK q , H q U) ) into a 

direct integral of the factor-representations, that corresponds to the center of U(GK q )" E q U ^ , 



(£0 

Vq —J 'lq 

s 



I ( s )d/J-(s) ■ hen 



i) for /x — a. a. s € S subspace {r/(s) € H q U) (s) : 
H s (u)r](s) = n(s) V u € U{GK q ) } is one- dimensional; 

ii) Tl(GNq)" is a factor in H q U) (s) ; 



m)H ( q V \s) 



[n s {GK q )r 1 *\s)] = [n s {GN q )r{ q U \s)\. 



for \i— a. a. s 6 S. 



Proof. Since GK q \s an .. group (see definition 3.1), and (II S , GK q , H q ' \s)) is a 
cyclic factor- representation, then the property (i) is a corollary of general theorem 3.4. 

Statement (ii) follows from the proposition 6.5. 



To prove (Hi) we notice, that subspace H ± (s) = H q U) (s) [Yl s (GN q )r] q " ' (s)] is 
Tl s (GN q ) —invariant. If H- L (s) 7^0, -P _L (s) is an orthoprojection from H q U) (s) to ^"'-(s) , 
then by the property (ii) in H s (GN q ) there exists a partial isometry w s , for which w s w* < 
P ± (s) and w s 7] q u) (s) ^ 0. By the construction the vector w s r] q U) (s) is H s (U(GN q )) — fixed. 
Since H s is an admissible representation for [i —a. a. s € S , then from the structure of the 
admissible representations of groups U(Sp(2oo)) and f7(0(2oo)) , that was completely 
described by ..Kirillov in [jlj], we get that vector w s n q U) (s) is IL^t/XG-fTg)) —fixed. But the 
last fact contradicts the property (i). Proposition 6.6 is proved. 

The next statement follows from statements 3.2, 6.1, 6.6 and classification theorem 5.10. 

Proposition 6.7. Let II be the same as in proposition 6.6. hen there exists 

ix— measurable field of the isometries V s (s G S) , that maps H q ' (s) to L2(A q ,v q ) such 
that operators V(s)Il s (g)V~ 1 = H s (g) act in L2(A q ,Vq) for g € GN q by: 

(n s (g q )ri)(\) = a A {X,g)r,(Xg) , 

(n s (^(x,0))r/)(A) = exp[mTr{z(s)\h)]ri(\) , (18) 

where a A is defined in the condition of theorem 2.1, z(s) is q x q— matrix, A is s.a. 
q x 



-matrix and q = r(II) 
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Moreover A does not depend on s , the mapping s — > z(s) is fx — measurable and the rang 
of z(s) equals to q for \i— a. a. s G S . 

Now we should get ( side by side with (18)) explicitly the form of the actions of operators 
U s (eM(x,y)),U s ( 7 ^(b)) and U s (^(b)) (see §3). 

The next statement follows from the commutation relations (8) and from propositions 6.6 
{Hi)- 6.7. 

Proposition 6.8. Let II satisfies to all the requests of proposition 6.1, and ILj (s G S) 
are built as in proposition 6.7. There exists ji — measurable mapping h from S to the set of 
symmetric (antisymmetric ) for G = Sp(2oo) (G = 0(2oo) ) q x q —matrices such that the 
operators H s (d) (<? G GK q ) act in L 2 (A q ,u q ) by : 

(n s (6M(a)) V )(\) =exp{mTr(ah(s))}ri(\), (19) 

(fl s (g q )r 1 )(X)=a A (X,g)r,(Xg) , (20) 
(U s (e {q) (x,0))r])(X) = exp[i$Tr(z(s)\h)]r)(\) , (21) 

(n s (^)(0,y))r ? )(A) = C/(y,A, S )- 

dUq{x+ Xw vh{s))t) \ ^ )(A + ^ • (22) 

(n s (7i 9) (b)) V )(X) = M(b, A, s)r,(X). (23) 
Moreover U and M are the unitary scalar functions. 

In the following statement we'll find an explicit form of cocycle U and function M , that 
are introduced in proposition 6.8. 

Lemma 6.9. If h(s) , z(s) (s G S) are the same as in conditions of 
propositions 6.7 - 6.8, then the following correlations are true: 

i) U{y,X,s) = exp{2iTr[X*Az- 1 (s)(yh(s)) t + 
(X*Az- l (s)(yh(s)) t )* + 2(z- l ( S )(yh( S )) t )*Az- 1 (s)(yh(s)) t ]} ; 

ii) h(s) for \i —a. a. s € S is an invertible; 

iii) M(b, A, s) = exp{ -i ^Tr[R{s) XbX 1 }} , 
where R(s) = \z t (s)h~ 1 (s)z(s) . 

Proof. In the following reasoning we omit some standard details of metric character. 

Let Y(oo,q) be a set of all local nonzero (oo x q)— matrices of infinite number of rows 
and q columns. If y £ Y(oo,q) , then we denote by y(k) a matrix from Y(oo,q) , that has 
only one nonzero k— th row, which coincides with the k — th row of matrix y . Since operator 
U s (9^ q \0,y(k))) commutes with all the U s (u) , where u 6 U(Gd(q, oo)) and satisfies to the 
correlation ue m = e m for m = ±k , then it's easy to show, that 

a) U(y(k), A, s) depends only on the variable k — th 
column of matrix A G A q ; 

b) U(y,X,s) =UU(y(k),X,s) 

k 
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We denote by Y q (oo,q) a subset in Y(oo,q), that consists of matrices, which has the 
elements of first q rows equal to zero. Let L q be a subgroup in Gd(q, oo) G G, that consists 

of matrices of the form l q {x) = y q £( ) / ' w ^ ere ^( x ) = I ^ ^ ' '' ' '' u ~ a " 



0/, 



arbitrary local nonzero q x oo — matrix. 



Element A 6 A, we will write as A = (A 9 , A(q,oo)) , where X q is q x q — matrix, that 
consists of first q columns of matrix A . 

If y G Y q (oo,q) , then from the correlation l q (x)8^ q \0,y) = 9^ q \0,y)l q (x) , setting 
a A (X,g) = exp{Tr[i AX(gg* - 1)A*]} and accounting (21) - (22), we get 

a A ((V -%! oo)) , K x )) u (.Vi (\> x (q, oo) + VO, s ) = 

a A ((X q ,X(q,oo) + 2z~ l {yh{s)) t ) , l(x))U(y,X,s) . (24) 

Let 

a(X,x,y) = exp{ — 2iTr[X*(q, oo) Az~ 1 {yh(s)) t + 
(X*(q, oo)A Z - 1 (yh(s)) t )* + x*X*Az~ 1 (s)(yh(s)) t + 
(x*X* q A Z - 1 (s)(yh(s)) t )* + 2(z- 1 (s)(yh(s)) t )*Az- 1 (s)(yh(s)) t }} . 
Since a A (X,g) = exp{Tr[i AX(gg* — 1)A*]} , then using (24) we get 

a(A, x, y)U{y, (X q , X(q, oo) + X q x), s) = 

a(X,0,y)U(y,X,s). (25) 

From the properties (a) - (b), accounting a form of the action of operators IL s (g q ) , 
Tl s (Q( q \0,y)) (see (20) and (22)) and the inclusion y G Y q (oo,q), it's easy to get that 
U(y, A, s) does not depend on X q . 

Hence, accounting (25), we get that a(A, 0, y)U(y, A, s) = c(y, s) does not depend on A . 
Therefore, 

U(y, A, s) = c(y, s) exp{ -2i Tr[X* (q, oo) Az~ 1 (yh(s)) t + 
(X%q^)Az-\yh(s)) t )* + 2(z'\ S ){yh( S )) t f Az^is^yhis)) 1 ]} 

for all y G V g (oo, q) and A G A g . 

Taking into account this correlation it's easy to check, that U(y, A, s) = U(y, A, s)c~ 1 (y, s) 
is 1-cocycle of action of group 0( q \o, Y q (oo,q)) to A q . Since U is also 1-cocycle, and c(y,s) 
does not depend on A, then c(-,s) is a multiplicative character of group Y q (oo,q)) . 



( o ,/. ) ■■"« 



/(•T 1 )' 0\ 
J, 
J, 



, then from the correlation 



V gj 

fl s (g q )U s (e( q )(0,y))(U s (g q ))* = U s (9( q \0, (g^fy)) , accounting (20), (22) and using the 
simple calculations, we get c(y,s) = c(((?f 1 ) y,s) Vgi . Therefore, c = 1. Correlation (i) is 
proved. 

To prove (ii) and (iii) we get the correlation, that connects z(s) and /i(s) (s G S) (see 
(19)-(23)). 
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Obviously the isometry V s (s <G S) from the proposition 6.7 maps H s (U(GK q )) — fixed 
vector rj q U \s) into the vector £o £ L 2 (A q ,v q ) determined by the function, that equals to 
unit on A„ . 



Let 



Since II is an admissible representation, then it extends by the continuity to s^P ( s^P ) . 
Moreover, operators II(s^) (n(s^)) we can approximate by the elements from H(U(GK q )) . 
Hence IL s (s±*)r] q U) (s) = rj q U) (s) (see lemma 6.3 and proposition 6.6). Therefore n s (s±^)£o = 
£o This condition and the correlation (s*±) 0( q \x,O)s±* = 9^(0,±x) lead to the equality: 

(IT(^)(x,0))£o,£o) = (n a (0fe)(o,± a ;))£o,£o). 

We calculate the both sides of this equality using ((i)) and the correlations (21) - (22), 
and we get 

exp | — -Tr(x*xz(s)z*(s))^ = 

exp{- Tr[x*x{Ah{s){{z- 1 )*A 2 z- l ) t h*{s) + /i(s)((^ 1 )* z' 1 )' h* (s))}} 

Therefore, 

z(s)z*(s) = AhisHz-^srfO. + iA 2 )\( Z - 1 (s)) t )*h*(s) . (26) 

Since rang z(s) = q for fi—&.&. s € S (see proposition 6.1), then from (26) we get the 
property (ii) . 

Let's pass to the proof of (Hi) . 

At first we notice that from (ii) it follows the correctness of the definition of matrix 
R(s) = \z t {s)h~ 1 {s)z{s). 

Put 

T(b,X,s) = exp{-i^Tr[R(s)XbX t }} . 

Correlation 9^\0,y)^(-b)e^{0,-y) = ^\-b)5^{(by) t y)9^{by,0) (see (8)) leads to the 
equality: 

M(-b,\ + 2 Z - 1 (yh{s)) t ,s) = M(-b,\,s)ex.p{i$lTr{[{by) t yh{s)+z(s)\by]} . 

Hence, accounting the definition of T(b, A, s) , we get 

M(-b, A + 2z~ 1 {yh(s))\ s)T(b, A + 2z~ 1 (y/i(s))*, s) = M(-b, A, s)T(b, A, s) . 

Since y is an arbitrary, nd rang h(s) = rang z(s) = q , then M(— b, A, s)T(b, A, s) = 
c(b, s) does not depend on A . Hence, accounting the definition of T(b, A, s) and correlation 
rfK&X^r 1 = l^KoW) (see (8)), we get c(6, s) = c{gbg\s) V 5 . Therefore, c(b,s) = 1 
for fi — a.a. s G S . Lemma 6.9 is proved. 
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Lemma 6.10 Let R(s) = \z t (s)h- 1 (s)z{s) , 
i 

\R(s)R*(s)\ 2 u(s) = R(s) is a polar decomposition of R(s) . 
hen for /j,—a.a. s £ S the following correlations are true: 

i) I + ^A 1 ) 2 = AR{s)R*(s) ; 

ii) -A = u*(s)A t u(s) . 

fig' 1 ? o o o\ 





Proof Let g q 







/, o 

Ig 



£o is a vector from L 2 (A g ,u g ) defined by 



V g) 



the function, that equals to unit. Suppose, that matrix g has a form > where 

g(n) is n x n — matrix, for which (g(n)g*(n) — I n ) is invertible. Identify C qn with a set of 
all complex n x q —matrices . 



By (20) 

(n s (5< ? )Co)(A) = exp 



-\Tr({l-2iA)\{gg* - 1)A* 



Hence and from (21) using the ordinary calculations we get 

(n s ( ffg )£o)(A) = c(<7, S ) | exp[-irr(z( S )l-2i^)- 1 - 

•z*( S )< t ( 5 (n) 5 *(n)-/„)- 1 x n )](n s ^W(x,0))^ )(A)dx n , 
where x n € C qn , x = ^ X ™ ^ , c(g, s) depends only on g and s . 

From the definition of s±* and from (27) the next chain of equalities follows: 



(27) 



((n s (4 9) )) _1 n s ( ff(? )n s (4 9) )^)(A) = (u s (( g ^)%)W 



exp 



(l-2zA)X((g- l ) t g- 1 -l)y 



c(g, s) 



exp 



Qqn 



\Tr(z{ S )l-2iA)- 1 z*(s)x* n (g{n)g*{n)-I n )- 1 x n ) 



■(U s (9^(0,±x))^)(X)dx n . 
Next, accounting (22) and a statement of lemma 6.9(i), we get: 

= c (a,s) ■ 

z(s)(l -2iA)- 1 z*(s)x* n (g(n)g*(n) - I n )~ x x n 



exp 



(l-2tA)X((g- 1 ) t g- 1 -l)y 



exp 



■I 

(Jqn 

-2(1 - 2iA)z- 1 (s)h(s)x t \* - 2h*(s)(z*(s)y 1 {l -2iA)Xx + 
+Axh*{s)(z*{s)y 1 (l - 2iA)z- l (s)h(s)x t ]\dx. 
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The calculation of integral in the right side leads to the correlation 



1. 



exp <J - -Tr 



(l-2 i A)X((g- 1 ) t g- 1 -l)X* 
exp |2Tr (1 - 2i A)^z*(s)(h*(s)y 1 z(s)(l - 2i A 1 )' 1 z\s)h- 1 (s)z(s)<S) (28) 



(5(n)5*(n)) 1 - 1 + 4(1 - 2i A)) {(1 - 2iA)\(n)}\*(n) 



}- 



Here A(n) consists of first n columns of matrix A , the action of the operator a (g> b on 
A € A q is defined by: (a <8> 6){A} = aA6 . 

If we use the ordinary calculation, we'll see that (28) is true if and only if 4(1 — 2iA) = 
z*{s){h*{s))~ l z{s){l-2iA t y l z t {s)h- 1 {s)z{s). Therefore, 



1 + 4(A') 2 = AR{s)R*{s) 

-4A = R*(s)(l + 4(^*) 2 ) _1 A*i?(s) . 



(29) 



If \R(s)R* (s)\ 2 u(s) = R(s) is a polar decomposition of R(s) , then from (29) it follows that 
—A = u*(s)A t u(s) . Lemma 6.10 is proved. 

For jjL — a. a. sGS representation II S of group GK q is defined by the set of parameters 
{A, z(s) , h(s)} , that was introduced in propositions 6.7 - 6.8. If eis a non negative 
number, then we denote by , <j(e) the 2x2 —matrices of the form <j(e) = 



ie 
-is 



e 
-e 



From the propositions 6.9 - 6.10 using the standard methods of elementary theory of 
matrices we can get the following statement. 

Proposition 6.11. There exists fi —measurable mapping w(-) from S into U(q) with 
the following properties: 
i) if G = Sp(2oo) , then 



w(s)Aw*(s) = d sp (A) 



/?(Ai) 2 ... 2 \ 

2 ?(A 2 ) ... 2 

2 2 ... ?(A fc ) 

V P / 



where P is zero p x p— matrix, Xj > for 
j = 1, 2, . . . , k (k may be equals to zero ) 
and 2k + p = q ; 

w(s)u(s)w*(s) = I q (see lemma 6.10) ; 

ii) if G = 0(2oo) , then 

/^(Ai) 2 
2 i?(A 2 ) 

t«(s)ylti;*(s) = d c (A) 



2 ^ 
2 

t?(A fc ) 



2 2 
V 2p / 

where 2p + 2k = q , i/ie resi properties of the parameters 
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of matrix d a (A) are the same as in (i); 

/?(-«) 2 ' 



u = w(s)u(s)w* (s) 



... 2 \ 

2 ?(-») ... 2 



V o 2 o 2 ... / 

iii) i? c = w(s)R(s)w*(s) = + 4iy(s)^l 2 u7*(s) tD(s)ii(s)u;*(s) 
does not depend on s . 

Consider the unitary operator W , that acts in L 2 (S, fj,) <g> L 2 (A q , v q ) by 
(Wt/)(s, A) = r?(s,iu*(s)A) , where r) £ L 2 (S, fi) ® L 2 (A q ,v q ) . 



The next statement follows from the propositions 6.6 - 6.8, 6.11 and has the same meaning 
for description of the representations of group G , as the lemma 5.5 in a case of GL(oo) . 

Proposition 6.12. We denote by V the isometry of a Hilbert space 

H q U) = j H ( q U) (s) dn(s) to L 2 (S,n)®L 2 (A q ,v q ), that defined by (Vr/)(s) = V s r)(s) , where 
s 

T](s) € H q U \s), V s rj(s) € L 2 (A q ,v q ) for fi—a.a. s G S (see propositions 6.6 - 6.7). For 
g € GK q we put 

11(g) = WVU(g)V*W* , ((s) = z(s)w*(s) . 

hen the action of operators 11(g) in L 2 (S,/j,) (g> L 2 (A q , v q ) is defined by correlations: 

(U(e^(x, 0)) V )(s, A) = exp[mTr(as)Xh)] V (s, A) ; (30) 
(U(g q )n)(s,X) = 



exp 



& do{A) (X,g)r)(s,\g),if g q € 0(2oo) ; 

(ii( 1 ^(b)) v )(s,\) = 

i,Tr[^l + A(d sp (A)f XbX 1 } },ifb = b 
exp | - iTr[yf 1 + 4(d (A)) 2 u AoA*] | , if b = -6* 
(see proposition 6.11(H) and lemma 6.9(ni)); 

(tl(e^(0,y)) V )(s,X) = U(y,X,s)- 

-dv q (X + 2C 1 (s)(yh(s)) 



(31) 



(32) 



dv q (X) 



" ~r ] )(s,X + 2C 1 (s)(yh(s)) t ) . (33) 
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The form of the unitary cocycle from the last correlation is given in the condition of lemma 
6.9 (see (22)). Moreover in the corresponding expression we should change z(s) into £(s) , 
and A- into w(s)Aw* (s) (see proposition 6.11). 

The advantage of the realization of II by correlations (20) - (23) is that the form of the 
action of operators fl(g q ) and II (7^) (6) does not depend on s. 

Since ft is an admissible representation, then it extends by continuity to the group, 
generated by GK q and s^P for G = Sp(2oo) or GK q and s^ for G = 0(2oo) . 

Change if we need H(U(GK q )) — fixed vector rj q (see lemma 6.3 and proposition 6.6 ) 
to cr] q , where c is an operator from the center of w*— algebra (H(GK q ))" , we may take 
WVn U q = £0 (see proposition 6.12). Vector £ is determined by the function on 5xA,, that 

equals to the unit. Therefore, il(s±^)£o = £0 • Hence and from the correlations (20), (22) we 
get 

(ri(4 9) )) _1 n(0(«)(x, o)£ = ii(0(9)(o, ±x)^ . 

Thus 

exp{iKTr(C(s)A/i)}??(s,A) ^4 
^exp{2irr[±AM tt (^)C- 1 (s)^(s)(C*(5)) _1 y*± 

±y(( S y 1 h( S )(- 1 (s)d i (A)\+ (34) 
+2y(( S y 1 h( S )(-Hs)d i (A)C\s)h t (s)(C 1 ) t y t }}. 
dv q (\ + 2C l ( S )h t (s)(C\s)) t y t ^' 

dv q (\) 

where ft means one of the indexes or sp . 
From this correlations we get an important 

Remark 6.13. Since Q(s) = z(s)w*(s), then by the statements 6.10 - 6.12 the next 
correlation is true 

R = w(s)R(s)w*(s) = ^C t (s)h- 1 (s)as) , 
and that's why the form of the action of the operator IL(s*±) does not depend on s G S . 

We denote by G(q, 00) a group generated by all the elements g q , 7^(6) , s±* . Obviously 
G(q, 00) C G(q, 00) . Therefore, for g G G(q, 00) 11(g) = ^ L 2 (Sm) ® ^(5) , where 11(g) is a 
unitary operator in L 2 (A q ,u q ) (see statements 6.12 - 6.13). We denote by i q a natural 
isomorphism of groups G(q, 00) and G (l q : g G 00) — ► <y*ga q 6G). 

The total of our reasoning is the following statement. 

Theorem 6.14. Let II 6e i/ie same as in propositions 6.1 - 6.4, £, is a cyclic vector 
for IT , £ g = II(<7 9 ) and Ha is a representation of group G built in §i (see propositions 1.2 - 
1.3). hen the restriction of U to G(q, 00), that acts in [H(G(q, oo))£ q ] , is multiple by the 
irreducible component of the representation, that defined by the chain of mappings: 

g G G(q, 00) — £ g (g) G G — > U A (e q (g)) . 
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To prove this theorem it suffices to notice that IT^ o £ q is naturally unitary equivalent 

to n. 



To formulate the main classification result let us notice the important moments of our 
reasoning. 

We have supposed , that the admissible factor-representation IT of group G is cyclic 
with the respect to the unit vector £ € Hjj (see remark 6.2). Then we've considered a 
restriction of IT to the subgroup G(q, oo) , that acts in [H(G(q, oo))IL(a q )£] . There was 
shown that , it is a subrepresentation of the spherical representations of larger group GK q 
(see proposition 6.4), for which in the proposition 6.12 explicit realization was given. Moreover 
the form of the operators 11(g) (see (31), (32) and (34)) for g € G(q, oo) does not depend 
on s € S (see also remark 6.13). At last in theorem 6.14 we've got the form of representation 
(IT , G(q, oo) , [H(G(q, oo))H(a q )^\) . Theorem 0.5 found by G.I. Ol'shansky let us turn to the 
representation II of group G . 

Because of this fact II extends by continuity to a q . Therefore the next correlation is 
true: 



(n^,0 Hn = (U(a q ga q * +I q (0))U(a q )CM^)0 Hn , 



(35) 



where I q (0) 






Vo 











I q 








0/ 



nd Cqgcrq* + 7 ? (0) belongs to G(q, oo) . 



Next, by theorem 6.14 in L q (see §1) , there exists vector /e , for which 
(U(a q ga q * + I q (0))U(a q )C,U(^)0 H = ° £ q (a q ga q * + 7,(0))/^ , . 

Hence and from (35) we get (Il(g)£,£) = (Il A (g)f^f^ . 

n 14 

This correlation and theorem 1.4 lead us to the main result of this chapter. 

Theorem 6.15. Let II he an admissible factor-representation of group G (G = Sp(2cc)or 
0(2oo)) . hen there exist: a natural number q, q x q— self-adjoint matrix A, that satisfies 
to the corresponding conditions of propositions 1.2-1.3, an admissible representation p of 
group 0(A,q) C U(q) for G = Sp(2oo) or Sp(A,m) C U(q) for G = O(2oo) (see §1) 
such that IT is multiple by restriction of Ha to P£L q (see theorem 1-4)- 
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